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Robot system equipped with a tool, camera and light 

source 

The present invention relates to a robot system that is 
provided with a light source and a camera for detecting 
geometric properties of a workpiece, and at least one 
tool in order to perform manipulations on the 
workpiece. Such a robot system is disclosed, for 
example, in JP-A-07-28 68 20. 

In this known robot system, a light source and a camera 
are mounted in common, but independently of a tool, at 
the tip of an articulated robot arm and can be 
positioned in space with a plurality of degrees of 
freedom such that the light source illuminates a 
workpiece to be machined and the camera records 
pictures of the workpiece . 

In this known system, the camera and light source 
cannot be moved relative to one another. It is true 
that with the aid of a projector the light source can 
optionally illuminate different strip-shaped zones in 
the field of view of the camera even without a movement 
of the light source, but the direction from which a 
specific point of an object in the field of view is 
irradiated is always the same as long as the light 
source and camera do not move jointly. This can render 
it very difficult to evaluate the images recorded by 
the camera, particularly when the regions of an object 
that are of interest are shaded by objects situated 
between the light source and them. 

It is an object of the invention to provide a robot 
system in which it is possible to implement optimum 
viewing conditions for a camera for the purpose of 
detecting a workpiece in conjunction with different 
geometries of the workpiece or an environment in which 
it is installed. 
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The object is achieved by virtue of the fact that the 
light source and the camera can be moved independently 
of one another in order to illuminate the field of view 
from different directions. That is to say, when a 
region of a workpiece that is of interest is poorly 
illuminated in the given position of the light source 
and camera with reference to one another, the light 
source can be moved independently of the camera in 
order to improve the illumination of this region. The 
variability of the alignment of the light source and 
camera relative to one another also facilitates the 
process of obtaining 3D information from an image 
recorded by the camera, since the change of the shape 
of shadows that is associated with a variation in the 
direction of irradiation onto an object permits an 
electronic unit for image evaluation that is possibly 
connected to the camera to distinguish shadow zones 
from surfaces that are intrinsically dark. 

A subassembly that comprises the camera and the light 
source as well as at least a first adjusting device for 
moving camera and light source relative to one another 
can preferably be moved by a second adjusting device 
with reference to a common base. Thus, for example, a 
standard position of the camera and light source with 
reference to one another that supplies useful images 
for most geometries of a workpiece to be examined can 
be set at the first adjusting device, and it is 
possible to operate only the second adjusting device in 
order to vary the field of view or viewing angle of the 
camera. Since this camera and light source move 
jointly, apart from parallax effects the light source 
remains aligned with the field of view of the camera 
without the need to control the movement of the former 
expressly. 



Of the camera and light source one is preferably firmly 
connected to the second adjusting device, such that its 



WO 2005/075158 PCT/EP2 005/000241 

- 3 - 

position and orientation is given completely and 
exclusively by the position of the second adjusting 
device, whereas the position of the light source with 
reference to the camera is defined by the position of 
the first adjusting device. 

Furthermore, a subassembly that comprises the camera 
and at least one of the tools as well as at least one 
third adjusting device for moving camera and tool 
relative to one another can be moved by a fourth 
adjusting device with reference to a common base. Here, 
as well, of the camera and tool in each case one is 
preferably firmly connected to the fourth adjusting 
device, such that its its position and orientation is 
given completely and exclusively by the position of the 
fourth adjusting device, and the position of the third 
adjusting device fixes the position of the camera and 
tool with reference to one another. 

The tools of the inventive robot system preferably 
include at least a gripping tool and a further tool for 
carrying out any desired machining step on the 
workpiece. The gripping tool, which is to be understood 
here as encompassing any desired tool for temporarily 
holding and, if appropriate, moving a workpiece, can be 
used, in particular, for the purpose of gripping and 
(at least temporarily) removing obstacles that 
otherwise prevent free access of the light from the 
light source, the view of the camera or the access of 
the further tool to a site of interest on the 
workpiece . 

Whereas the mobility of the further tool with reference 
to the camera can be restricted, it is desirable for 
the gripping tool and the camera to have as high a 
number of degrees of freedom as possible in the 
relative movement so that the gripping tool can remove 
obstacles without for its part impairing the field of 
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view of the camera. Consequently, the gripping tool and 
the camera are preferably mounted on mutually 
independent moveable carriers, in other words the 
number of degrees of freedom with which the gripping 
5 tool and the camera can be moved with reference to one 
another is greater than the number of degrees of 
freedom of the camera and the gripping tool with 
reference to a stationary part of the robot system. 



10 Further features and advantages of the invention emerge 
from the following description of exemplary embodiments 
with reference to the attached figures. In the drawing: 



figure 1 
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figure 2 



figure 3 



figure 4 



shows a first exemplary embodiment of an 
inventive robot system in which a camera, 
light source and tool are respectively 
carried by a robot arm mounted on a 
stationary base; 

shows a modification of the robot system from 
figure 1, equipped with two tools; 
shows a second refinement of a robot system 
equipped with two tools; and 

shows a third refinement of the robot system, 
in which robot arms carrying the camera, 
light source and tool are mounted on a 
gantry . 



Figure 1 shows a schematic of the fundamental principle 
of the invention. A stationary base 1 mounted, for 

3 0 example, on the floor of a workshop carries a robot arm 
2 with a number of articulated members 3 . Articulations 
4 between the base 1 and the members 3 or between two 
members 3 each have at least one, preferably a number 
of degrees of rotational freedom and can be driven by a 

35 control device (not illustrated) in order to position 
and to swivel a tool 5 mounted at the end of the arm 2 
in all three spatial positions and doing so as desired 
within the scope of the range of the arm 2 . The tool 5 
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can be of any desired known suitable type for machining 
a workpiece 6, for example a gripper, a drill, a 
milling machine, a welding tool, etc. 

5 A second base 7 carries a second robot arm 8 whose 
design can be the same as that of the robot arm 2 . 
Mounted at the free end of the robot arm 8 is a camera 
9 that can be positioned as desired in space under the 
control of the control device and can be aligned with 

10 the workpiece 6 in order to supply images of the 
workpiece 6 to the control device. Projecting from the 
camera 9 is a rail 10 on which a carriage 11 can be 
moved under the control of the control device. The 
carriage 11 carries a light source 13 by means of a 

15 likewise controllable articulation 12. The light source 
13 can be a simple spotlight with reflectors such as is 
indicated in the figure that has a cone of light, with 
a principal ray direction B, which can be aligned with 
the workpiece 6, by displacing the carriage 11 and 

20 swiveling the articulation 12, from various angles 
relative to the direction of view of the camera 9. The 
rail 10 can preferably be rotated about the optical 
axis A of the camera 9 such that not only is the angle 
between the principal ray direction B of the light 

25 source 13 and the optical axis A of the camera 9 
variable, but also the position of the plane defined by 
these two directions. Whilst the robot arm 8 
constitutes a first adjusting device with which the 
control device can displace camera 9 and light source 

30 13 in a fixed relationship to one another as regards 
position, the carriage 11 and the articulation 12 are 
part of a second adjusting device with the aid of which 
in the event of a given position and orientation of the 
camera 9 the illumination of the field of view of the 

3 5 camera 9 can be varied in order to find that 
illumination which respectively enables details of the 
workpiece 6 that are of interest to be detected most 
effectively. 
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A preferred development of the robot system is shown in 
figure 2. Parts of this robot system that already 
correspond with reference to parts described figure 1 
bear the same reference numerals and are not described 
anew if there are no differences from the configuration 
of figure 1. The free end of the robot arm 8, which 
carries the camera 9, here forms the base of a third 
robot arm 14 at whose free end the gripping tool 15 is 
located. The gripping tool 15 can have in the usual way 
a number of fingers, that can be moved relative to one 
another, for clamping the workpiece 6 or a part thereof 
or, when the part to be gripped is ferromagnetic, it 
can include an electromagnet, and it can have a suction 
cup connected to a vacuum source or any other desired 
device for temporarily keeping hold of an object. When 
the control device identifies in the image supplied by 
the camera 9 an object that obstructs the view onto the 
site on the workpiece 6 that is of interest, or which 
shades this site, it drives the gripping tool 15 so as 
to remove the relevant object temporarily, for example 
so as to push aside a hose connected to the workpiece 
to be examined, or so as to pull out a plug- in 
connector connected thereto. After the workpiece has 
been inspected, the plug- in connector is plugged in 
again by the gripping tool 15. 

The light source 13 is mounted here on a third 
stationary base 16 by means of a fourth robot arm 17 
and, by contrast with the gripping tool 15, therefore 
does not move in a fashion coupled to the camera 9. It 
therefore does not restrict the mobility of the robot 
arm 14 around the camera 9. Alternatively, the gripping 
tool 15 and the light source 13 could, of course, both 
be mounted on the robot arm 8 in a moveable fashion 
with reference to the camera 9. 
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In the configuration shown in figure 3, the tool 5 and 
the camera 9 are mounted at the free end of the first 
robot arm 2. The camera 9 can be firmly connected to 
the tool 5 in a fashion permanently aligned with a tip 
of the tool 5 that interacts with the workpiece . The 
light source 13 and the gripping tool 15, which is 
connected thereto via the robot arm 14 , are arranged on 
the second robot arm. As long as the arm 14 is not 
moved, the gripping tool 15 follows every movement of 
the light source, and is thus always located in the 
vicinity of the light source when it is required in 
order to remove an obstruction between the light source 
and the surface, observed by the camera 9, of the 
workpiece 6 or between this surface and the camera 9 . 

Figure 4 shows a schematic of a robot system in the 
case of which the arm 2 carrying the tool 5, and the 
arm 8 carrying the camera 9 and the light source 13 are 
mounted on rails 18 of a crab 19 that for its part can 
move on rails 20 of a gantry superstructure. The design 
and mode of operation of the arms 2, 8 is the same here 
as in the case of figure 1. If desired, however, the 
number of the articulations 4 in the case of the arms 
2, 8 of this exemplary embodiment can be reduced by 
comparison with figure 1, since the mobility along the 
rails 18, 2 0 adds two degrees of freedom to the 
translation. 

The robot arms could also be mounted jointly on a 
vehicle in accordance with a modification that is not 
shown . 



